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Abstract 

While the best known outerbound for the K user interference channel states that there cannot be more than K/2 
degrees of freedom, it has been conjectured that in general the constant interference channel with any number of 
users has only one degree of freedom. In this paper, we explore the spatial degrees of freedom per orthogonal time 
and frequency dimension for the K user wireless interference channel where the channel coefficients take distinct 
values across frequency slots but are fixed in time. We answer five closely related questions. First, we show that 
K/2 degrees of freedom can be achieved by channel design, i.e. if the nodes are allowed to choose the best constant, 
finite and nonzero channel coefficient values. Second, we show that if channel coefficients can not be controlled by 
the nodes but are selected by nature, i.e., randomly drawn from a continuous distribution, the total number of spatial 
degrees of freedom for the K user interference channel is almost surely K/2 per orthogonal time and frequency 
dimension. Thus, only half the spatial degrees of freedom are lost due to distributed processing of transmitted and 
received signals on the interference channel. Third, we show that interference alignment and zero forcing suffice to 
achieve all the degrees of freedom in all cases. Fourth, we show that the degrees of freedom D directly lead to an 
O(l) capacity characterization of the form C(SNR) = Dlog(l + SNR) + 0(1) for the multiple access channel, 
the broadcast channel, the 2 user interference channel, the 2 user MIMO X channel and the 3 user interference 
channel with M > 1 antennas at each node. It is not known if this relationship is true for all networks in general, 
and the K user interference channel with a single antenna at all nodes in particular. Fifth, we consider the degree 
of freedom benefits from cognitive sharing of messages on the 3 user interference channel. If only one of the three 
messages is made available non-causally to all the nodes except its intended receiver the degrees of freedom are 
not increased. However, if two messages are shared among all nodes (except their intended receivers) then there are 
two degrees of freedom. We find that unlike the 2 user interference channel, on the 3 user interference channel a 
cognitive transmitter is not equivalent to a cognitive receiver from a degrees of freedom perspective. If one receiver 
has cognitive knowledge of all the other users' messages the degrees of freedom are the same as without cognitive 
message sharing. However, if one transmitter has cognitive knowledge of all the other users' messages then the 
degrees of freedom are increased from 3/2 to 2. 



I. Introduction 

The capacity of ad-hoc wireless networks is the much sought afer "holy-grail" of network information theory 
[1]. While capacity characterizations have been found for centralized networks (Gaussian multiple access and 
broadcast networks with multiple antennas), similar capacity characterizations for most distributed communication 
scenarios (e.g. interference networks) remain long standing open problems. In the absence of precise capacity 
characterizations, researchers have pursued asymptotic and/or approximate capacity characterizations. Recent work 
has found the asymptotic scaling laws of network capacity as the number of nodes increases in a large network [2], 
[3]. However, very little is known about the capacity region of smaller (finite) decentralized networks. An important 
step in this direction is the recent approximate characterization of the capacity region of the 2 user interference 
channel that is accurate within one bit of the true capacity region [4]. Approximate characterizations of capacity 
regions would also be invaluable for most open problems in network information theory and may be the key to 
improving our understanding of wireless networks. 

It can be argued that the most preliminary form of capacity characterization for a network is to characterize 
its degrees of freedom. The degrees of freedom represent the rate of growth of network capacity with the log 
of the signal to noise ratio (SNR). In most cases, the spatial degrees of freedom turn out to be the number of 
non-intefering paths that can be created in a wireless network through signal processing at the transmitters and 
receivers. While time, frequency and space all offer degrees of freedom in the form of orthogonal dimensions over 
which communication can take place, spatial degrees of freedom are especially interesting in a distributed network. 
Potentially a wireless network may have as many spatial dimensions as the number of transmitting and receiving 
antennas. However, the ability to access and resolve spatial dimensions is limited by the distributed nature of the 
network. Therefore, characterizing the degrees of freedom for distributed wireless networks is by itself a non-trivial 
problem. For example, consider an interference network with n single-antenna transmitters and n single-antenna 
receivers where each transmitter has a message for its corresponding receiver. For n = 2 it is known that this 
interference network has only 1 degree of freedom [5], [6]. There are no known results to show that more than 1 
degrees of freedom are achievable on the interference channel with any number of users. It is conjectured in [7] 
that the K user interference channel has only 1 degree of freedom. Yet, the best known outerbound for the number 
of degrees of freedom with K interfering nodes is K/2, also presented in [7]. The unresolved gap between the 
inner and outerbounds highlights our lack of understanding of the capacity of wireless networks because even the 
number of degrees of freedom, which is the most basic characterization of the network capacity, remains an open 
problem. It is this open problem that we pursue in this paper. 

To gain a better understanding of the interference channel, we first consider the possibility that the transmitters 
and receivers can place themselves optimally, i.e., the nodes can choose their channels. Thus, the first objective of 
this paper is to answer the question: 

Question 1: What is the maximum number of degrees of freedom for the K user interference channel if we are 
allowed to choose the best (finite and non-zero) channel coefficient values ? 

While the scenario above offers new insights, in practice it is more common that the channel coefficients are chosen 
by nature. The nodes control their coding schemes, i.e. the transmitted symbols, but not the channel coefficients, 
which may be assumed to be randomly drawn from a continuous distribution and causally known to all the nodes. 
In this context we ask the main question of this paper: 

Question 2: What is the number of degrees of freedom for the K user interference channel per orthogonal time 



and frequency dimension ? 

Note that the normalization by the number of orthogonal time and frequency dimensions is necessary because 
we wish to characterize the spatial degrees of freedom. 

Spatial degrees of freedom have been characterized for several multiuser communication scenarios with multiple 
antenna nodes. The (M, N) point to point MIMO channel has min(M, N) degrees of freedom [8], [9], the 
(Mi, M 2 , N) multiple access channel has min(Mi + M 2 , N) degrees of freedom [10], the (M, Ni,N 2 ) broadcast 
channel has min(M, Ni + N 2 ) degrees of freedom [11]— [13], and the {Mi,M 2 ,N\,N 2 ) interference channel has 
min(Mi + M 2 ,N± + N 2 , max(Mi, N 2 ), max(M 2 , N{)) degrees of freedom [6], where M t (or M when only one 
transmitter is present) and JV f (or N when only one receiver is present) indicate the number of antennas at the i th 
transmitter and receiver, respectively. 

If one tries to extrapolate these results into an understanding of the degrees of freedom for fully connected (all 
channel coefficients are non-zero) wireless networks with a finite number of nodes, one could arrive at the following 
(incorrect) intuitive inferences: 

• The number of degrees of freedom for a wireless network with perfect channel knowledge at all nodes is an 
integer. 

• The degrees of freedom of a wireless network with a finite number of nodes is not higher than the maximum 
number of co-located antennas at any node. 

The degrees of freedom characterizations for the point to point, multiple access, broadcast and interference scenarios 
described above are all consistent with both these statements. Note that the results of [14] indicate that even with 
single antenna sources, destinations and relay nodes the network can have more than one degree of freedom. 
However, for this distributed orthogonalization result it is assumed that the number of relay nodes approaches 
infinity. Thus it does not contradict the intuition above which is for finite networks. Multihop networks with half- 
duplex relay nodes may also lead to fractional degrees of freedom due to the normalization associated with the 
half-duplex constraint. This is typically because of the absence of a direct link across hops, i.e. some channel 
coefficients are zero. For multihop networks with orthogonal hops [15] has shown that the full N degrees of 
freedom are achievable even if each intermediate hop consists of N (distributed) single antenna relay nodes as long 
as the initial source node and the final destination nodes are equipped with TV antennas each. Note that the result of 
[15] is also consistent with the inferences described above. Also, we note that channels with specialized structures 
or cooperation among nodes may be able to achieve higher degrees of freedom than channels whose coefficients 
are randomly selected from continuous distributions [16]. 

Perhaps biased by these results, most work on degrees of freedom for wireless networks has focused on either 
networks where some nodes are equipped with multiple antennas [6], [15] or networks with single antenna nodes 
where some form of cooperation opens up the possibility that the single antenna nodes may be able to achieve 
MIMO behavior [5], [7], [17]. Networks of single antenna nodes with no cooperation between the transmitters or 
receivers could be considered uninteresting from the degrees of freedom perspective as the above mentioned intuitive 
statements would suggest that these networks could only have 1 degree of freedom. In other words, one might argue 
that with a single antenna at each node it is impossible to avoid interference and therefore it is impossible to create 
multiple non-interfering paths necessary for degrees of freedom. The 2 user interference network with a single 
antenna at each node is a good example of a network which adheres to all the above intuitive inferences, where 
indeed it can be rigorously shown that there is only one degree of freedom. Studying a K user interference channel 



where all channel coefficients are equal will also lead to only one degree of freedom, as will the K user interference 
channel with i.i.d. channel coefficients and no knowledge of channel coefficients at the transmitters [14]. Similarly, 
if all receivers observe signals that are degraded versions of, say, receiver l's signal then it can again be argued 
that the MAC sum capacity when receiver 1 decodes all messages is an outerbound to the interference channel sum 
capacity (Carleial's outerbound [18]). Thus the degrees of freedom cannot be more than the number of antennas 
at receiver 1. Finally, the conjecture that the K user interference channel has only 1 degree of freedom is also 
consistent with this intuition [7]. 

Clear evidence that the intuitive conclusions mentioned above do not apply to all wireless networks is provided 
by the recent degree of freedom region characterization for the 2 user X channel in [19]-[22]. The 2-user X 
channel is identical to the 2-user interference channel with the exception that each transmitter in the X channel 
has an independent message for each receiver. Thus, unlike the interference channel which has only 2 messages, 
the X channel has 4 messages to be communicated between two transmitters and two receivers. Surprisingly, it 
was shown in [22] that the X channel, with only a single antenna at all nodes has 4/3 degrees of freedom per 
orthogonal time/frequency dimension if the channels are time/frequency selective. This is interesting for several 
reasons. First, it shows that the degrees of freedom can take non-integer values. Second, it shows that the degrees 
of freedom of a distributed wireless network can be higher than the maximum number of co-located antennas at 
any node in the network. Finally, the achievability proof for the non-integer degrees of freedom for the X channel 
uses the novel concept of inteference-alignment [20]-[23]. Interference alignment refers to the simple idea that 
signal vectors can be aligned in such a manner that they cast overlapping shadows at the receivers where they 
constitute interference while they continue to be distinct at the receivers where they are desired. The possibility 
of implicit interference alignment was first observed by Maddah-Ali, Motahari and Khandani in [20]. The first 
explicit interference alignment scheme was presented in [23] where it was shown to be sufficient to achieve the full 
degrees of freedom for the MIMO X channel. Interference alignment was subsequently used in [21], [22] to show 
achievability of all points within the degrees of freedom region of the MIMO X channel. Interference alignment 
was also independently discovered in the context of the compound broadcast channel in [24]. 

Since the distinction between the X channel and the interference channel is quite significant, it is not immediately 
obvious whether the results found for the X channel have any implications for the interference channel. For instance, 
the achievability schemes with inteference alignment proposed in [21] utilize the broadcast and multiple access 
channels inherent in the X channel. However, the interference channel does not have broadcast and multiple access 
components as each transmitter has a message for only one unique receiver. Therefore, in this paper we answer the 
following question. 

Question 3: What are the degrees of freedom benefits from interference alignment on the K user interference 
network? 

The degrees of freedom can be viewed as a capacity characterization that is accurate to within o(log(p)) where 
p represents the signal to noise ratio (SNR). In order to pursue increasingly accurate capacity characterizations, in 
this paper we explore the notion of 0(1) capacity of a network. The 0(1) capacity is an approximation accurate to 
within a bounded constant of the actual capacity region. The constant term can depend only on the channel gains 
and is independent of the transmit powers of the users. The 0(1) capacity is a more accurate description of the 
network capacity than the degrees of freedom of a network. Interestingly, for the point to point MIMO channel the 
0(1) capacity C(p) is directly related to the degrees of freedom D as C(p) = Dlog(l + p). This leads us to the 



third set of questions that we pursue in this paper. 

Question 4: Is the 0(1) capacity C{p) of the multiple access and broadcast channels, as well as the 2 user 
interference and X channels related to the degrees of freedom D as C(p) = Dlog(l + p)? Does the same 
relationship hold for the K user interference channel? 

Finally, we explore the benefits in terms of degrees of freedom, from the cognitive sharing of messages on the 
interference channel. Based on the cognitive radio model introduced in [25]-[27] cognitive message sharing refers 
to the form of cooperation where a message is made available non-causally to some transmitters and/or receivers 
besides the intended source and destination of the message. It was shown in [17] that for the 2 user interference 
channel with single antennas at each node, cognitive message sharing (from one transmitter to another) does not 
produce any gain in the degrees of freedom. The result was extended in [22] to the 2 user interference channel 
with multiple antenna nodes and equal number of antennas at each node, to show that there is no gain in degrees of 
freedom whether a message is shared with the transmitter, receiver or both the transmitter and receiver of the other 
user. [22] also establishes an interesting duality relationship where it is shown that from the degrees of freedom 
perspective cognitive transmitters are equivalent to cognitive receivers, i.e. sharing a message with another user's 
transmitter is equivalent to sharing a message with the other user's receiver. It is not clear if similar results will 
hold for the 3 user interference channel, and it forms the last set of questions that we address in this paper. 

Question 5: For the 3 user interference channel, what are the benefits of cognitive message sharing? Are 
cognitive transmitters equivalent to cognitive receivers in the manner shown for the 2 user interference channel? 

A. Overview of Results 

The answer to the first question is provided in Section [HI] and may be summarized in general terms as follows: 

"Regardless of how many speakers and listeners are located within earshot of each other, each speaker can speak 
half the time and be heard without any interference by its intended listener" 

This result may seem impossible at first. For example, how can a total duration of 1 hour be shared by 100 
speakers such that each speaker speaks for 30 minutes and is heard interference free by its intended listener when 
all systems are located within earshot of each other? And yet, this seemingly impossible result is made possible by 
the concept of interference alignment. A simple scheme is explained in Section [ill] where it is assumed the speakers 
and listeners can choose their locations. 

The answer to the second question is provided in Theorems [T] and |2] We show that the K user interference 
channel with single antennas at all nodes has (almost surely) a total of K/2 degrees of freedom per orthgonal time 
and frequency dimension when the channels are drawn randomly from a continuous distribution. The implications 
of this result for our understanding of the capacity of wireless networks are quite profound. It shows that we have 
grossly underestimated the capacity of wireless networks. For example, at high SNR the true capacity is higher 
by 50%, 900%, and 4900% than anything previously shown to be achievable for networks with 3, 20, and 100 
interfering users, respectively. Interference is one of the principal challenges faced by wireless networks. However, 
we have shown that with perfect channel knowledge the frequency selective interference channel is not interference 
limited. In fact, after the first two users, additional users do not compete for degrees of freedom and each additional 
user is able to achieve 1/2 degree of freedom without hurting the previously existing users. What makes this result 
even more remarkable is that linear scaling of degrees of freedom with users is achieved without cooperation in 
the form of message sharing that may allow MIMO behavior. Note that it has been shown previously for the 2 user 
interference channel that unidirectional message sharing (e.g. from transmitter 1 to transmitter 2) does not allow 




higher degrees of freedom [17], [22] and even bi-directional message sharing (through full duplex noisy channels 
between the transmitters and full duplex noisy channels between the receivers) will not increase the degrees of 
freedom if the cost of message sharing is considered [7], [28]. Therefore it is quite surprising that the K user 
interference channel has K/2 degrees of freedom even without any message sharing. To summarize, Theorem Q] 
shows that only half the degrees of freedom are lost due to distributed processing at the transmitters and receivers 
on the interference channel. 

The answer to question 3 is provided by the achievability proof for Theorem Q] where we find that, similar to the 
2 user X channel, interference alignment suffices to achieve all the degrees of freedom on the K user interference 
channel as well. Thus, interference alignment is as relevant for the K user interference channel where it achieves 
the full K/2 degrees of freedom, as it is for the 2 user X channel where it achieves the full 4/3 degrees of freedom. 
Interestingly, interference alignment does for wireless networks what MIMO technology has done for the point to 
point wireless channel. In both cases the capacity, originally limited to log(l + SNR), is shown to be capable of 
linearly increasing with the number of antennas. While MIMO technology requires nodes equipped with multiple 
antennas, interference alignment works with the distributed antennas naturally available in a network across the 
interfering transmitters and receivers. 

Figure Q] shows how interference alignment applies to the 3 user interference channel. In this figure we illustrate 
how 4 degrees of freedom are achieved over a 3 symbol extension of the channel with 3 single antenna users, so 
that a total of 4/3 degrees of freedom are achieved per channel use. The achievability proof for 3/2 degrees of 
freedom is more involved and is provided in Section IIV-AI User 1 achieves 2 degrees of freedom by transmitting 
two independently coded streams along the beamforming vectors vj 1 ' , v^ 1 ' while users 2 and 3 achieve one degree of 
freedom by sending their independently encoded data streams along the beamforming vectors , v^ 3 \ respectively. 
The beamforming vectors are chosen as follows. 



• At receiver 1, the interference from transmitters 2 and 3 are perfectly aligned. 

• At receiver 2, the interference from transmitter 3 aligns itself along one of the dimensions of the two- 
dimensional interference signal from transmitter 1. 

• Similarly, at receiver 3, the interference from transmitter 2 aligns itself along one of the dimensions of 
interference from transmitter 1. 

For the answer to question 4, we show that for the multiple access, broadcast, and 2 user interference and X 
channels, the total degrees of freedom D and the 0(1) capacity C(p) are indeed related as C(p) = Z?log(l + p). 
Thus, the two descriptions are equivalent. However, for the 3 user interference channel with single antenna nodes 
it appears unlikely that such a relationship exists. The evidence in this paper raises the interesting possibility that 
the sum capacity of the K user interference channel with single antenna nodes may have a different form than the 
multiple access, broadcast, and 2 user interference and X channels in that the difference between the true capacity 
C(p) and the degrees of freedom approximation £>log(l + p) may not be bounded. 

Finally, the answer to question 5 is provided in Theorem [5] We show that sharing one message with all other 
transmitters and/or receivers does not increase the degrees of freedom for the 3 user interference channel. Sharing 
two messages with all other transmitters and/or receivers on the other hand raises the degrees of freedom from 
3/2 to 2. Interestingly, we find that the equivalance established between the cognitive transmitters and cognitive 
receivers on the 2 user interference channel does not directly apply to the 3 user interference channel. Intuitively, 
this may be understood as follows. A cognitive transmitter on the 3 user interference channel can be more useful 
than a cognitive receiver. This is because a cognitive transmitter with no message of its own can still increase the 
degrees of freedom by canceling interference from its cognitively acquired message at other receivers. In other 
words a cognitive transmitter with no message of its own, still lends a transmit antenna to the transmitter whose 
message it shares. On the other hand, a cognitive receiver with no message of its own is useless. 

II. System Model 

Consider the K user interference channel, comprised of K transmitters and K receivers. We assume coding may 
occur over multiple orthogonal frequency and time dimensions and the rates as well as the degrees of freedom are 
normalized by the number of orthogonal time and frequency dimensions. Each node is equipped with only one 
antenna (multiple antenna nodes are considered later in this paper). The channel output at the k th receiver over the 
/ frequency slot and the t th time slot is described as follows: 

rW (/, t) = (f)X^ {f, t) + i# 2 l (f)X^ (/,*) + ... + {f)xw (/ 7 1) + (/, t) 

where, k £ {1,2,- •• , K} is the user index, / € N is the frequency slot index, t G N is the time slot index, 
y[ fc l(/, t) is the output signal of the k th receiver, X^(f, t) is the input signal of the k th transmitter, H^(f) 
is the channel fade coefficient from transmitter j to receiver k over the f th frequency slot and Z^(f,t) is the 
additive white Gaussian noise (AWGN) term at the k th receiver. The channel coefficients vary across frequency 
slots but are assumed constant in time. We assume all noise terms are i.i.d. (independent identically distributed) 
zero mean complex Gaussian with unit variance. We assume all channel coefficients HV° J '(f) are known a-priori 
to all transmitters and receivers. Note that since the channel coefficients do not vary in time, only causal channel 
knowledge is required. If we allow non-causal channel knowledge then the channel model above is equivalently 
represented as coding entirely in the time domain, i.e. over only one frequency slot. To avoid degenerate channel 
conditions (e.g. all channel coefficients are equal or channel coefficients are equal to either zero or infinity) we 



assume that the channel coefficient values are drawn i.i.d. from a continuous distribution and the absolute value of 
all the channel coefficients is bounded between a non-zero minimum value and a finite maximum value. Since the 
channel values are assumed constant in time, the time index t is sometimes suppressed for compact notation. 

We assume that transmitters 1, 2, • ■ ■ , K have independent messages W\, W 2l • • • , Wk intended for receivers 
1, 2, • • ■ , K, respectively. The total power across all transmitters is assumed to be equal to p per orthogonal time 
and frequency dimension. We indicate the size of the message set by For codewords spanning / x to 

channel uses (i.e. using f frequency slots and to time slots), the rates Ri(p) = log are achievable if the 
probability of error for all messages can be simultaneously made arbitrarily small by choosing an appropriately 
large f t Q . 

The capacity region C(p) of the three user interference channel is the set of all achievable rate tuples R(p) = 
(R 1 (p),R 2 (p),--- ,Rk(p))- 

A. Degrees of Freedom 

Similar to the degrees of freedom region definition for the MIMO X channel in [22] we define the degrees of 
freedom region V for the K user interference channel as follows: 



V= |(di,d2,"- ,d K ) eK+ :V(wi,w 2 ,-- - ,wk) eK+ 



w\d\ + w 2 d 2 + • • • + wxdK < limsup 

p^OO 



sup [w 1 R 1 (p) + w 2 R2(p) H h w K R K (p)} 1 

R(p)gc(p) log(p) 



(1) 

III. Interference Alignment through Channel Design 

With the exception of this section, throughout this paper we assume that the channel coefficients are determined 
by nature, i.e. we do not control the channel values, and we only control the coding scheme, i.e. the transmitted 
symbols. However, in this section we take a different perspective to gain additional insights into the problem. We 
wish to know what is the best we can do if we are allowed to pick all the channel coefficient values subject to 
the only constraint that the coefficient values are finite, non-zero constants. It is important that we can only pick 
non-zero channel coefficient values because the K/2 outerbound applies if and only if all channel coefficients have 
non-zero values. For example, if we are allowed to set some channel coefficients to zero the problem becomes 
trivial because by setting all interfering links to zero we can easily achieve K degrees of freedom over the K 
non-interfering channels. 

A. Interference Alignment by Choice of Channel Coefficients 

As we show next, we can achieve K/2 degrees of freedom for the K user interference channel with non-zero 
channel coefficients if we are allowed to pick the values of the channel coefficients. The proof is quite simple. We 
consider a two symbol extension of the channel, i.e. coding over two frequency slots, where the channel is defined 
by 2 x 2 diagonal channel matrices that we choose as follows 

1 

-1 

1 
1 



] \ 



it i^j (2) 
if i = j (3) 



Each user transmits his coded symbols along the beamforming vector 



This ensures that all the interference terms at each receiver appear along the direction vector [1 — 1] T while the 
desired signal at each receiver appears along the direction [1 1] T . Thus the desired signal and interference are 
orthogonal so that each user is able to achieve one degree of freedom for his message. Since K degrees of freedom 
are achieved over the 2 symbol extension of the channel the degrees of freedom equal K/2. Thus, it is interesting to 
note that the K/2 outerbound is tight for some interference channels with non-zero channel coefficients. Since joint 
processing at all transmitters and at all receivers would result in K degrees of freedom on the K user interference 
channel, we observe that if we are allowed to pick the channel coefficients then the maximum penalty for distributed 
signal processing is the loss of half the degrees of freedom. It remains to be shown if this bound is tight when 
channel coefficients are chosen by nature, i.e. modeled as random variables drawn from a continuous distribution. 
As we show in the next section, the outerbound of K/2 is almost surely tight for the K user interference channel. 

B. Interference alignment through choice of propagation delays - Can everyone speak half the time with no 
interference? 

We end this section with another interesting example of interference alignment. Consider the K user interference 
channel where there is a propagation delay from each transmitter to each receiver. Let T,j represent the signal 
propagation delay from transmitter i to receiver j. Suppose the locations of the transmitters and receivers can 
be configured such that the delay Tu from each transmitter to its intended receiver is an even multiple of a basic 
symbol duration T s , while the signal propagation delays T.- L j from each transmitter to all unintended receivers 

are odd multiples of the symbol duration. The communication strategy is the following. All transmissions occur 
simultaneously at even symbol durations. Note that with this policy, each receiver sees its own transmitter's signal 
interference-free over even time periods, while it sees all interfering signals simultaneously over odd time periods. 
Thus each user is able to achieve 1/2 degrees of freedom and the total degrees of freedom achieved is equal to 
K/2. 

IV. Degrees of Freedom for the K User Interference Channel - Interference Alignment 

THROUGH PRECODING 

Henceforth, we assume that the channel coefficients are not controlled by the nodes but rather selected by 
nature. Thus, the channels do not automatically align the interference and any interference alignment can only be 
accomplished through code design. The following theorem presents the main result of this section. 

Theorem 1: The number of degrees of freedom for the K user interference channel with single antennas at all 
nodes is K/2. 

max di + d 2 H h d K = K/2 (5) 

The converse argument for the theorem follows directly from the outerbound for the K user interference channel 
presented in [7]. The achievability proof is presented next. Since the proof is rather involved, we present first the 
constructive proof for K = 3. The proof for general K > 3 is then provided in Appendix U 



A. Achievability Proof for Theorem\l\with K = 3 

We show that (d%, ^2,^3) = ( 2n+i > 2J+1 > 2n+i ) ^ es m ^ e degrees of freedom region Mn <G N. Since the degrees 
of freedom region is closed, this automatically implies that 

3n + 1 3 
2 



max c?i + c?2 + ^3 > sup ■ 

(di,d 2 ,d 3 )ei? " n 2n 



1 



This result, in conjunction with the converse argument proves the theorem. 

To show that ( £n+i > 2n+i 1 2ri+i ) ^ es m ^ we construct an interference alignment scheme using only 2n + 1 
frequency slots. We collectively denote the 2n + 1 symbols transmitted over the first 2n + 1 frequency slots at 
each time instant as a supersymbol. We call this the (2n + 1) symbol extension of the channel. With the extended 
channel, the signal vector at the k th user's receiver can be expressed as 

Y^UhNxW+H^X^+H^xP' + zW, fc = l,2,3. 

where X^ is a (2n + 1) x 1 column vector representing the 2n + 1 symbol extension of the transmitted symbol 
XW, i.e 

JfW(l.t) 
xW(2,t) 



(t) 



ZW(2n + l,t) 

Similarly Y[ fe ] and Z[ fe ] represent 2n+ 1 symbol extensions of the Y^ k ' and Z' k ' respectively. H^'l is a diagonal 
(2n + 1) x (2n + 1) matrix representing the 2n + 1 symbol extension of the channel i.e 

fffe'l(l) . .. 
fffe'l(2) ... 

••• H^(2n+1) 

Recall that we assume that the channel coefficient values for each frequency slot are chosen independently from a 
continuous distribution. Thus, all the diagonal channel matrices are comprised of all distinct diagonal elements 
with probability 1. 

We show that (d\, d%, cfe) = (n+1, n, n) is achievable on this extended channel implying that ( £n+i > 2n+i > SnTl ) 
lies in the degrees of freedom region of the original channel. 

In the extended channel, message Wi is encoded at transmitter 1 into n+1 independent streams Xm(t),m = 
1, 2, . . . , (n + 1) sent along vectors v m ' so that X M(i) is 

n+1 

x [11 (t) = E^(^=v [1, x [11 (i) 

m—1 

where XM(i) is a (n + 1) x 1 column vector and VW is a (2ri + 1) x (n + 1) dimensional matrix. Similarly W2 
and W3 are each encoded into n independent streams by transmitters 2 and 3 as Xl 2 ! (t) and X^ (t) respectively. 



xn(t) = 5>S(*H 



XM(t) = 5>M ( t )v . 

m—1 



[3] 



The received signal at the i th receiver can then be written as 

In this achievable scheme, receiver i eliminates interference by zero-forcing all =/= i to decode Wj. At 

receiver 1, n+1 desired streams are decoded after zero-forcing the interference to achieve n+1 degrees of freedom. 
To obtain n+1 interference free dimensions from a 2n + 1 dimensional received signal vector (t), the dimension 
of the interference should be not more than n. This can be ensured by perfectly aligning the interference from 
transmitters 2 and 3 as follows. 

g[12]y[2] = g[13]y[3] (6) 

At the same time, receiver 2 zero-forces the interference from X^l and Xl 3 l. To extract n interference-free 
dimensions from a 2n + 1 dimensional vector, the dimension of the interference has to be not more than n + 1. i.e. 

' "gPilyW H [23] V [31 " 



rank ^ 

This can be achieved by choosing V^ 3 ' and so that 

h[ 23 1v [3] -< g[ 21 ]v [11 



< n + 1 



(7) 



where P -< Q, means that the set of column vectors of matrix P is a subset of the set of column vectors of matrix 
Q. Similarly, to decode W3 at receiver 3, we wish to choose Vl 2 l and VW so that 



g[32]y[2] -< H [31I V [l1 



(8) 



Thus, we wish to pick vectors V"M, V^ 2 ] and so that equations (|6j, (Q, (HJl are satisfied. Note that the channel 
matrices H^l have a full rank of 2n + 1 almost surely. Since multiplying by a full rank matrix (or its inverse) 
does not affect the conditions represented by equations ©, (0 and (0, they can be equivalently expressed as 



B 
B 

C 



-< 



TC 

A 

A 



where 



A 
B 
C 
T 



= (fi[ 21 l)- 
= (fi[ 31 l)- 

= H [12] (H 1211 ) _1 H [231 (H [32I ) _1 H [311 (H [13] ) _1 



-ig^Vl 31 
-ig 1321 ^ 121 



(9) 
(10) 
(11) 

(12) 
(13) 
(14) 
(15) 



Note that A is a (2ri + 1) x (n + 1) matrix. B and C are (2n + 1) X n matrices. Since all channel matrices are 
invertible, we can choose A, B and C so that they satisfy equations (l9T>-(fTTT> and then use equations (fT2b-(TT3T> to 
find VW,VW and V^. A, B, C are picked as follows. Let w be the (2n + 1) x 1 column vector 



w = 



.. T"w] 
T"w] 



T n_1 wl 



We now choose A, B and C as: 

A = [w Tw T 2 w 
B = [Tw T 2 w .. 
C = [w Tw 

It can be easily verified that A, B and C satisfy the three equations (l9t- ([TTl i. Therefore, V"W, V^ 2 ' and V' 3 ! satisfy 
the interference alignment equations in ©, (|7]i and ((H). 

Now, consider the received signal vectors at Receiver 1. The desired signal arrives along the n + 1 vectors 
H^'V' 1 ' while the interference arrives along the n vectors H[ 12 ]"V[ 2 1 and the n vectors H^V"! 3 !. As enforced 
by equation © the interference vectors are perfectly aligned. Therefore, in order to prove that there are n + 1 
interference free dimensions it suffices to show that the columns of the square, (2n + 1) x (2n + 1) dimensional 
matrix 



SMyW h [121 v [21 



(16) 



are linearly independent almost surely. Multiplying by the full rank matrix (H^ 11 !) 1 and substituting the values 
of VM, VP 2 !, equivalently we need to show that almost surely 



S = [w Tw T 2 w . . . T"w Dw DTw DT 2 w 



DT" _1 wl 



(17) 



has linearly independent column vectors where D = (fi[ 11 ]) _1 H[ 12 ] is a diagonal matrix. In other words, we need 
to show dct(S) ^ with probability 1. The proof is obtained by contradiction. If possible, let S be singular with 
non-zero probability, i.e, Pr(|S| = 0) > 0. Further, let the diagonal entries of T be Ai, A2, . . . A271+1 and the 
diagonal entries of D be k%, K2 ■ ■ . K2 n +i- Then the following equation is true with non-zero probability. 

\2 \n „ „ \ „ \n— 1 



Ai 
A 2 



A 2 



A? 
AS 



«1 
K 2 



KlAi 
K2A2 



^Ar 1 







1 A 2n+ 1 A 2 Jl+1 . . . A 2 l „ +1 K 2n +1 K2n+lA2n+l • ■ ■ H 2n +1^2n+l 

Let Cij indicate the cofactor of the ith row and jth column of |S|. Expanding the determinant along the first row, 
we get 

|S| = => C\\ + A1C12 + . . . A"Ci(„ + i) + K\ [Ci(„ +2 ) + AiCi(„ +3 ) + . . . + A™ 1 Ci( 2 „+i)] = 

None of 'co-factor' terms C\j in the above expansion depend Ai and K\. If all values other than K\ are given, then 
the above is a linear equation in m. Now, |S| = implies one of the following two events 

1) K\ is a root of the linear equation. 

2) All the coefficients forming the linear equation in K\ are equal to 0, so that the singularity condition is trivially 
satisfied for all values of n\. 

Since K\ is a random variable drawn from a continuous distribution, the probability of K\ taking a value which is 
equal to the root of this linear equation is zero. Therefore, the second event happens with probability greater than 
and we can write, 



Pr(|S| = 0) > 



P r (Cl(n+2) + AlC 1 („ +3 ) + . . . + A" 1 C 1 ( 2n+ i) — 0) > 



Consider the equation 



Cl(n+2) + AlCi(„_|_3) + . . . + A" 1 Ci( 2li +l) — 

Since the terms C\j do not depend on Ai, the above equation is a polynomial of degree n in Ai. Again, as before, 
there are two possibilities. The first possibility is that Ai takes a value equal to one of the n roots of the above 
equation. Since Ai is drawn from a continuous distribution, the probability of this event happening is zero. The 
second possibility is that all the coefficients of the above polynomial are zero with non-zero probability and we 
can write 

Pr(C 1(n+2) + . . . + KiA?C 1(2n+1) = 0) > =► Pr(C 1(2 „ +1) = 0) > 

We have now shown that if the determinant of the (2n + 1) x (2n + 1) matrix S is equal to with non-zero 
probability, then the determinant of following 2n x 2n matrix (obtained by stripping off the first row and last 
column of S) is equal to with non-zero probability. 

1 A 2 A2 . . . A 2 



det 



1 A2n-| 



X 2 

A 2n+1 



A 



2n+l 



K-2n+l K2„+lA2n+l 



K2Ar 2 



K2n+lA 2 „ +1 







with probability greater than 0. Repeating the above argument and eliminating the first row and last column at each 
stage we get 



det 



1 A 



n+l 



1 A2n+1 



X 2 

A n+1 



X 2 

A 2n+1 



X™ 

A n+1 



A 



2)1+1 



= 



with probability greater than 0. But this is a Vandermonde matrix and its determinant 

n - a j) 

n+l<i<j<2n+l 

is equal to only if A; = Xj for some i + 1 j. Since Ai are drawn independently from a continuous distribution, 
they are all distinct almost surely. This implies that Pr(|S| = 0) = 0. 

Thus, the n+l vectors carrying the desired signal at receiver 1 are linearly independent of the n interference 
vectors which allows the receiver to zero force interference and obtain n+l interference free dimensions, and 
therefore n+l degrees of freedom for its message. 

At receiver 2 the desired signal arrives along the n vectors H[ 22 ]V"[ 2 1 while the interference arrives along the n + l 
vectors H^VW and the n vectors H^V"! 3 ]. As enforced by equation (0 the interference vectors H^Vl 3 ! are 
perfectly aligned within the interference vectors H^lvW. Therefore, in order to prove that there are n interference 
free dimensions at receiver 2 it suffices to show that the columns of the square, (2n + 1) x (2n + 1) dimensional 
matrix 



g[ 22 ]v[ 2 l H [21] V [ 



(18) 



are linearly independent almost surely. This proof is quite similar to the proof presented above for receiver 1 and is 
therefore omitted to avoid repetition. Using the same arguments we can show that both receivers 2 and 3 are able 




to zero force the n + 1 interference vectors and obtain n interference free dimensions for their respective desired 
signals so that they each achieve n degrees of freedom. 

Thus we established the achievability of d\ + d 2 + d 3 = ^Z+i ^ or an ^ n ' scneme ' a l° n g with the converse 
automatically imply that 

, 7 3 
sup d\ + d 2 + d 3 = - 

B. The Degrees of Freedom Region for the 3 User Interference Channel 

Theorem 2: The degrees of freedom region of the 3 user interference channel is characterized as follows: 

■D = {(di,d 2 ,d 3 ) : 

di+d 2 < 1 
d 2 + d 3 < 1 

di+d 3 < 1} (19) 
Proof: The converse argument is identical to the converse argument for Theorem [T] and is therefore omitted. 
We show achievability as follows. Let V be the degrees of freedom region of the 3 user interference channel. We 
need to prove that V =T). We show that T> C V which along with the converse proves the stated result. 

The points K = (0,0,1), L = (0,1,0), J — (1,0,0) can be verified to lie in V through trivial achievable 
schemes. Also, Theorem Q] implies that N = (|, ^, ^) lies in V (Note that this is the only point which achieves a 
total of | degrees of freedom and satisfies the inequalities in ( fT9b . Consider any point (d\, d 2l d 3 ) E T> as defined 
by the statement of the theorem. The point (di, d 2 ,d 3 ) can then be shown to lie in a convex region whose corner 
points are (0, 0, 0), J, K, L and N. i.e (di, d 2 ,d 3 ) can be expressed as a convex combination of the end points (see 
Fig.©. 

(d 1 ,d 2 ,d 3 ) = ai (l, 0,0) + a a (0, 1,0) + a 3 (0,0, 1) + a A {\, i, ~) + a B (0, 0,0) 



where the constants are defined as follows. 
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It is easily verified that the values of ai are non-negative for all (di, d 2 , d 3 ) E 2? and that they add up to one. Thus, 
all points in T> are convex combinations of achievable points J, K, L, N and (0, 0, 0). Since convex combinations 
are achievable by time sharing between the end points, this implies that V C V . Together with the converse, we 
have T> = T> and the proof is complete. ■ 
Note that the proof presented above uses coding over multiple frequency slots where the channel coefficients 
take distinct values. We now examine the possible ramifications of this assumption both from a theoretical as well 
as a practical perspective. 

From a theoretical perspective the assumption of frequency selective channels is intriguing because it is not clear 
if K/2 degrees of freedom will be achieved with constant channels over only one frequency slot. Therefore the 
validity of the conjecture in [7] that the interference channel with constant channel coefficients has only 1 degree 
of freedom for any number of users still remains undetermined. The issue is analogous to the 2 user X channel 
with a single antenna at all nodes. It is shown in [22] that the time/frequency varying MIMO X channel has 4/3 
degrees of freedom per time/frequency dimension. However, it is not known whether the X channel with single 
antenna nodes and constant channel coefficients can achieve more than 1 degree of freedom. 

From a practical perspective, we present several observations. 

1) The assumption that the channel coefficients vary over frequency is not restrictive as it holds true in practice for 
almost all wireless channels. Moreover, note that it is not necessary that the channel coefficients are independent 
across frequency slots. It suffices that they are chosen according to a continuous joint distribution. 

2) We have shown that by coding over 2n + 1 frequency slots, we can achieve 2n+i degrees of freedom on 
the 3 user interference channel. The fact that only a finite number of frequency slots suffice to achieve a 
certain number of degrees of freedom may be significant in practice. On the other hand if non-causal channel 
knowledge is not an issue and the channel is time varying then only one frequency slot suffices for this 
achievability proof. 

3) Recall that for the 2 user X channel, time and frequency variations are not needed when more than 1 antenna 
is present at each node. Similarly, we will show in Section [VI] that with M > 1 antennas at each node the 3 
user interference channel with constant channel matrices has 3A//2 degrees of freedom. 

Before considering the MIMO case with constant channel matrices we visit the issue of 0(1) capacity. 

V. The 0(1) Capacity of Wireless Networks 

Consider a multiuser wireless channel with transmit power p, noise power normalized to unity, and sum capacity 
C(p). The degrees of freedom d provide a capacity approximation that is accurate within o(log( j o)), i.e., 

C[p) =dlog(p)+o(log(p)) (20) 

where the little "o" notation is defined as follows: 

f(x) = o(g(x)) ^ lim 44 = 0. (21) 



C( P ) 



Similarly, one can define a capacity characterization C\{p), that is accurate to within an 0(1) term, 

limsup|C(p) -Ci(p)| < oo. (22) 

so that we can write 

C(p) = C 1 (p) + 0(l) (23) 

While the 0(1) notation implies an asymptotic approximation as p — > oo, it is easy to see that for all communi- 
cation networks, if the 0(1) capacity characterization is known, then one can find a capacity characterization that 
is within a constant of the capacity for all p. This is because the capacity C(p) is a non-negative, monotonically 
increasing function of the transmit power p. This is seen as follows. Let C\(p) be an 0(1) capacity characterization. 
Mathematically, 3p D , C < oo, such that 

sup |C(p)-^i(p)| <C a . (24) 

P>Po 

Then we can construct a capacity characterization C(p) that is accurate to within a constant for all p as follows: 

a f 0i (p ) Vp< Po 1 
Cl{p) Vp> Po J 

such that the absolute value of the difference between the capacity C(p) and C(p) is bounded above by max{0 o , C\{p)}. 

Clearly, the 0(1) capacity provides in general a more accurate capacity characterization than the degrees of 
freedom definition. However, it turns out that in most cases the two are directly related. For example, it is well 
known that for the full rank MIMO channel with M input antennas and N output antennas, transmit power p and 
i.i.d. zero mean unit variance additive white Gaussian noise (AWGN) at each receiver, the capacity C(p) may be 
expressed as: 

C(p) = mm{M, N) log(l + p) + 0(1) = d!og(l + p) + 0(1). (25) 

As formalized by the following theorem, a similar relationship between the degrees of freedom and the 0(1) 
capacity characterization also holds for most multiuser communication channels. 

Theorem 3: For the MIMO multiple access channel, the MIMO broadcast channel, the two user MIMO inter- 
ference channel and the 2 user MIMO X channel, an 0(1) characterization of the sum capacity can be obtained 
in terms of the total number of degrees of freedom as follows: 

C(p)=dlog(l + p) + 0(l). (26) 
Proof: Since the proof is quite simple, we only present a brief outline as follows. For the MIMO MAC and BC, 
the outerbound on sum capacity obtained from full cooperation among the distributed nodes is d log(l + p) + 0(1). 
The innerbound obtained from zero forcing is also rflog(l + p) + 0(1) so that we can write C(p) = rflog(l + 
p) + 0(1). For the two user MIMO interference channel and the 2 user MIMO X channel the outerbound is 
obtained following an extension of Carlieal's outerbound which results in a MIMO MAC channel. The innerbound 
is obtained from zero forcing. Since both of these bounds are within 0(1) of dlog(l + p) we can similarly write 
0(p) = dlog(l + p) + 0(l). ■ 
Finally, consider the K user interference channel with single antennas at each node. In this case we have only 
shown: 

{K/2 - e) log(l + p) + 0(1) < C(p) < (K/2) log(l + p) + 0(1), Ve > 0. (27) 



Consider a hypothetical capacity function C(p) = K/2 log(l +p) — cyQog(l + p 2 ). Such a capacity function would 
also satisfy the inner and outerbounds provided above for the K user interference channel and has D = K/2 degrees 
of freedom. However, this hypothetical capacity function does not have a 0(1) capacity characterization equal to 
C(p) = if/21og(l + p) as the difference between C(p) and C(p) is unbounded. To claim that the 0(1) capacity 
of the 3 user interference channel is (3/2) log(l + p) we need to show an innerbound of (K/2) log(l + p) + 0(1). 
Since our achievable schemes are based on interference alignment and zero forcing, the natural question to ask is 
whether an interference alignment and zero forcing based scheme can achieve exactly K/2 degrees of freedom. 
The following explanation uses the K = 3 case to suggest that the answer is negative. 

Consider an achievable scheme that uses a M symbol extension of the channel. Now, consider a point (a±, a 2 , a^) 
that can be achieved over this extended channel using interference alignment and zero-forcing alone. If possible, 
let the total degrees of freedom over this extended channel be 3AI/2. i.e. ot\ + a 2 + ct3 = 3M/2. It can be argued 
along the same lines as the converse part of Theorem Q] that (ai, ctj) is achievable in the 2 user interference channel 
for V(i,j) € {(1,2), (2, 3), (3,1)}. Therefore 

a± + a 2 < M 
«2 + c*3 < M 

0(1 + CK3 < M 

It can be easily seen that the only point (ai, a 2 , a^) that satisfies the above inequalities and achieves a total of 
3Af / 2 degrees of freedom is (f-, f-, f-). Therefore, any scheme that achieves a total of 3M/2 degrees of freedom 
over the extended channel achieves the point 4r, -y). 

We assume that the messages Wi are encoded along Al/2 independent streams similar to the coding scheme in 
the proof of Theorem Q] i.e. 

M/2 

X [4] = 5>WvW=vMxN 

m— 1 

Now, at receiver 1, to decode an M/2 dimensional signal using zero-forcing, the dimension of the interference has 
to be at most M/2. i.e., 

rankp^Vl 3 ] & 12 W™]=M/2 (28) 

Note that since has M/2 linearly independent column vectors and H^ 12 ! is full rank with probability 1, 
rank(Hl 12 lv[ 2 l) = M/2. Similarly the dimension of the interference from transmitter 3 is also equal to M/2. 
Therefore, the two vector spaces on the left hand side of equation (|28l must have full intersection, i.e 

span(H [13l V [3] ) = span(H [12l V [21 ) (29) 
span(H [23l V [3] ) = span(H [211 V [1] ) (At receiver 2) (30) 
span(H [32l V [2] ) = span(H [31I V [l1 ) (At receiver 3) (31) 

where span(A) represents the space spanned by the column vectors of matrix A The above equations imply that 

spantHl 13 ]^ 23 ])- 1 !!^^ 1 ]) = spantH^Hl 32 ])- 1 !!! 31 ^ 1 ]) 

=> span(V [1] ) = span(TV [1] ) 



where T = (H[ 13 ]) _1 H1 23 ](H[ 21 ]) -1 H[ 12 ](H[ 32 1) _1 H[ 31 1. The above equation implies that there exists at least one 
eigenvector e of T in span(VM). Note that since all channel matrices are diagonal, the set of eigenvectors of 
all channel matrices, their inverses and their products are all identical to the set of column vectors of the identity 
matrix, i.e vectors of the form [0 ... 1 ... 0] T . Therefore e is an eigenvector for all channel matrices. Since e 
lies in span(VM), equations (|29| >-(|3T1i imply that 

e e span(H^V^), Vi, j G {1,2,3} 
=^e e span(H [111 V [1] ) nspan(H [12l V [2] ) 

Therefore, at receiver 1, the desired signal H^lvW is not linearly independent with the interference H^V™. 
Therefore, receiver 1 cannot decode W\ completely by merely zero-forcing the interference signal. Evidently, 
interference alignment in the manner described above cannot achieve exactly 3/2 degrees of freedom on the 3 user 
interference channel with a single antenna at all nodes. 

Thus, the degrees of freedom for the 3 user interference channel with M — 1 do not automatically lead us to 
the 0(1) capacity. The possibility that the sum capacity of the 3 user interference channel with single antennas 
at all nodes may not be of the form (3/2)log(l + p) + 0(1) is interesting because it suggests that the 3 user 
interference channel capacity may not be a straightforward extension of the 2 user interference channel capacity 
characterizations . 

We explore this interesting aspect of the 3 user interference channel further in the context of multiple antenna 
nodes. Our goal is to find out if exactly 3M/2 degrees of freedom may be achieved with M antennas at each node. 
As shown by the following theorem, indeed we can achieve exactly 3M/2 degrees of freedom so that the 0(1) 
capacity characterization for M > 1 is indeed related to the degrees of freedom as C(p) = (3M/2) log(l + p). 

VI. Degrees of freedom of the 3 user interference channel with M > 1 antennas at each node 

AND CONSTANT CHANNEL COEFFICIENTS 

The 3 user MIMO interference channel is interesting for two reasons. First we wish to show that with multiple 
antennas we can achieve 3M/2 degrees of freedom with constant channel matrices, i.e., multiple frequency slots 
are not required. Second, we wish to show that exactly 3M/2 degrees of freedom are achieved by zero forcing 
and interference alignment which gives us a lowerbound on sum capacity of 3M/21og(l + p) + 0(1). Since the 
outerbound on sum capacity is also 3A//21og(l + p) + 0(1) we have an 0(1) approximation to the capacity of 
the 3 user MIMO interference channel with M > 1 antennas at all nodes. 

Theorem 4: In a 3 user interference channel with M > 1 antennas at each transmitter and each receiver and 
constant coefficients, the sum capacity C(p) may be characterized as: 

C(p) = (3M/2) log(l + P ) + 0(1) (32) 
The proof is presented in Appendices [TT] and [TlJJ 

VII. Cognitive Message Sharing on the 3 user Interference Channel 

Cognitive message sharing refers to a form of cooperation between transmitters and/or receivers where the message 
of one user is made available non-causally to the transmitter or receiver of another user. Degrees of freedom with 
cognitive cooperation are considered in [17] and [23]. It is shown in [22] that for the two user interference channel 
with equal number M of antennas at all nodes there is no gain in degrees of freedom when one user has a cognitive 
transmitter, a cognitive receiver or both. In all these cases the total degrees of freedom equals M. However the 



full 2M degrees of freedom are obtained if both users have a cognitive transmitter, or both users have a cognitive 
receiver, or one user has a cognitive transmitter and the other user has a cognitive receiver. In this section we 
generalize this result to the three user interference channel. 

To generalize the result we introduce some notation. Let % be defined as the set of messages available non- 
causally at transmitter i and receiver i. Let us also define TZi as the set containing the message intended for receiver i 
and also the messages non-causally available at receiver i. With no cognitive sharing of messages % = TZi = {Wi\. 
Further, let us define Wi — % U TZi. The following theorem presents the total number of degrees of freedom for 
some interesting cognitive message sharing scenarios. 

Theorem 5: The total number of degrees of freedom 77* for the 3 user interference channel under various 
cognitive message sharing scenarios are determined as follows: 

1) If only one message (e.g. W\) is shared among all nodes the degrees of freedom are unchanged. 

m = {VKi}, W 2 = {W U W 2 },W 3 = {W U W 3 } ^r,* = 3/2. (33) 

Note that this includes all scenarios where message W\ is made available to only the transmitter, only the 
receiver or both transmitter and receiver of users 2 and 3. In all these cases, there is no benefit in terms of 
degrees of freedom. 

2) If two messages (e.g. W\, W 2 ) are shared among all nodes then we have 2 degrees of freedom. 

Wi = {W u W 2 }, W 2 = {Wi, W 2 }, W 3 = {W u W 2 ,W 3 } => 77* = 2 (34) 

Note that the messages W\ , W 2 may be shared through cognitive transmitters, receivers or both. 

3) If only one receiver (e.g. receiver 3) is fully cognitive then we have 3/2 degrees of freedom. 

Wi - {Wi},W 2 - {W 2 },% - {W 3 },TZ 3 = {W U W 2 ,W 3 } => 77* = 3/2 (35) 

4) If only one transmitter (e.g. transmitter 3) is fully cognitive then we have 2 degrees of freedom. 

m = {VKi}, W 2 = {W 2 }, % = {W U W 2 ,W 3 }, TZ 3 = {W 3 } => 77* = 2 (36) 
The last two cases are significant as they show the distinction between cognitive transmitters and cognitive receivers 
that was not visible in the two user interference channel studied in [22]. In [22] it was shown that from a degree 
of freedom perspective, cognitive transmitters are equivalent to cognitive receivers for the two user interference 
channel. However, cases 3 and 4 above show that cognitive transmitters may be more powerful than cognitive 
receivers. Intuitively, a cognitive receiver with no message of its own is useless whereas a cognitive transmitter 
with no message of its own is still useful. 
Proof: 

1) Consider the case where W\ is shared with either the transmitter or receiver (or both) of user 2 and user 3. 
Now, with W\ = (f> we have a two user interference channel with no cognitive message sharing which gives us 
the outerbound d 2 + d 3 < 1. For the next outerbound, set W 2 = <p and let the transmitter of user 2 cooperate 
with the transmitter of user 1 as a two antenna transmitter. We now have a two user cognitive interference 
channel with user 1 as the primary user (with two transmit antennas and one receive antenna) and user 3 with 
the cognitive transmitter, cognitive receiver or both. Using the standard MAC outerbound argument it is easily 
seen that by reducing the noise at receiver 1 we must be able to decode both messages W\ , W 3 at receiver 1 . 
This gives us the outerbound di + d 3 < 1. Similarly, we obtain the outerbound di + d 2 < 1. Adding up the 



three outerbound we have i]* < 3/2. Since 3/2 degrees of freedom are achievable even without any cognitive 
cooperation, we have 77* = 3/2. Note that this result is easily extended to K users, i.e. with only one message 
shared among all nodes the degrees of freedom are not increased. 

2) For achievability, set W3 = and let transmitter 3 stay silent. Then we have a cognitive two user interference 
channel with two shared messages which has 2 degrees of freedom as established in [22]. For the converse 
argument let transmitter 1 and 2 cooperate as a two antenna transmitter T 12 and receiver 1 and 2 cooperate 
as a two antenna receiver R 12 . Then we have a two user cognitive interference channel where the primary 
user has two transmit and two receive antennas while the cognitive user has a single transmit antenna and a 
single receive antenna. Once again, the standard MAC outerbound argument is used to show that by reducing 
noise at the primary receiver, we must be able to decode all messages at the primary receiver. This gives us 
the outerbound d\ + d 2 + (I3 < 2. Since the inner and outerbounds agree, 77* = 2. 

3) Achievability of 3/2 degrees of freedom is trivial as no cognitive message sharing is required. For the converse, 
setting Wi,W 2 ,W3 to (f> one at a time leads to the two user cognitive interference channel with one shared 
message for which the degrees of freedom are bounded above by 1. Adding the three outerbounds we conclude 
that 7]* = 3/2. This result is also easily extended to the K user interference channel. 

4) For achievability, set W 3 — cf). Then we have a two user interference channel with a cognitive helper (transmitter 
3) who knows both user's messages. Two degrees of freedom are achieved easily on this channel as transmitters 
1 and 3 cooperate to zero force the transmission of W\ at receiver 2, while transmitters 2 and 3 cooperate to 
zero force the transmission of W 2 at receiver 1. By eliminating interference at receivers 1 and 2, we have two 
degrees of freedom. The converse follows directly from the converse for part 2, so that we have 77* = 2. 

■ 

VIII. Conclusion 

We have shown that with perfect channel knowledge the K user interference channel has K/2 spatial degrees of 
freedom. Conventional wisdom has so far been consistent with the conjecture that distributed interfering systems 
cannot have more than 1 degree of freedom and therefore the best known outerbound K/2 has not been considered 
significant. This pessimistic outlook has for long invited researchers to try to prove that more than 1 degree of 
freedom is not possible while ignoring the K/2 outerbound. The present result shifts the focus onto the outerbound 
by proving that it is tight if perfect and global channel knowledge is available. Thus, the present result could guide 
future research along an optimistic path in the same manner that MIMO technology has shaped our view of the 
capacity of a wireless channel. There are several promising directions for future work. From a practical perspective it 
is important to explore to what extent interference alignment can be accomplished with limited channel knowledge. 
Simpler achievability schemes are another promising avenue of research. For example, the interference alignment 
scheme based on different propagation delays that we presented in this paper is an exciting possibility as it only 
requires a careful placing of interfering nodes to satisfy certain delay constraints. 



Appendix I 

ACHIEVABILITY FOR THEOREmQ]fOR ARBITRARY K 



Let N ={K- 1)(K - 2) - 1. We show that (di(n), d 2 {n) 
the K user interference channel for any neN where 



■ dic(n)) lies in the degrees of freedom region of 



di (n) 
di(n) 



{n+l) N + n N 



2,3... K 



This implies that 



max d\ + d% + • • • > sup 

(d 1 ,d 2 ,...d K )£'D n 



(n+l) N + n N ' 

(n + l) N + (K - l)n N 



= K/2 



(n + l) N + n N 

We provide an achievable scheme to show that ((n + l) N , n N , n N . . . n N ) lies in the degrees of freedom region 
of an M n = (n + 1) N + n N symbol extension of the original channel which automatically implies the desired 
result. In the extended channel, the signal vector at the k th user's receiver can be expressed as 

K 

Y [fc] W = 5^H [fcJ] xM(i) + 2W(t) 

i=i 

where is an M n x 1 column vector representing the M n symbol extension of the transmitted symbol X^- k \ i.e 

xW(M n ,t)) 

Similarly and represent M n symbol extensions of the Y<- k ' and respectively. is a diagonal 

M n x M n matrix representing the M n symbol extension of the channel i.e 

HW(1) ... 
iJfel(2) ... 

••■ HlW(M n ) 

Recall that the diagonal elements of HW'l are drawn independently from a continuous distribution and are therefore 
distinct with probability 1. 

In a manner similar to the K = 3 case, message W\ is encoded at transmitter 1 into in + l) N independent 
streams Xm(t), m — 1,2, . . . , (n + 1)^ along vectors vS so that XM(t) is 

(„+!)" 



XW(*)= E «£ ] (*)vB=Wl(t) 



m— 1 



where (t) is a (n+l) N x 1 column vector and VW is a M n x (n+ l) N dimensional matrix. Similarly Wj, i ^ 1 
is encoded into n K independent streams by transmitter i as 



xM(i) = 5>W(t) v W=vMxW(t) 



The received signal at the i th receiver can then be written as 

K 

Y W (t) = HM V^XM (i) + ZW (t) 
i=i 

All receivers decode the desired signal by zero-forcing the interference vectors. At receiver 1, to obtain (n+ l) w 
interference free dimensions corresponding to the desired signal from an M n = (n+l) N + n N dimensional received 
signal vector YW, the dimension of the interference should be not more than n N . This can be ensured by perfectly 
aligning the interference from transmitters 2, 3 ... K as follows 

jj[ 12 lv [21 = H [13I V [31 = H I14I V l4] = . . . = H [1K] V [K] (37) 

At the same time, receiver 2 zero-forces the interference from XW,i / 2. To extract n N interference-free 
dimensions from a M n = (n+1) + n N dimensional vector, the dimension of the interference has to be not more 
than (n + l) N . 

This can be achieved by choosing VW,i ^ 2 so that 

h[ 23 ]v[ 3 ] -< gi^ivi 1 ) 

(38) 



g[2*T]y[K] ^ g' 21 '?' 1 ' 

Notice that the above relations align the interference from K—2 transmitters within the interference from transmitter 
1 at receiver 2. Similarly, to decode Wi at receiver i when i / 1 we wish to choose so that the following 
K — 2 relations are satisfied. 

-< H [il lV"W,j £ {l,t} (39) 

We now wish to pick vectors , i = 1, 2 ... K so that equations d37l ). d38l ) and (f39b are satisfied. Since channel 
matrices gWl have a full rank of M n almost surely, equations d37l i. ( f38l > and d39b can be equivalently expressed as 



' 2] B = B 


-< 




t' 2] b 


-< 


> 


t£ ] b 


-< 


J 


if B 


-< 


yli] ' 


if b 


-< 


vw 




-< 


vw > 


t !+i b 


-< 


vw 


T^B 


-< 


J 



3 = 2,3,4. ..K 



At receiver 2 



At receiver 1 



(40) 



(41) 



At receiver i where i = 3 . . . K 



(42) 



S M = (aP^-ifi! 13 ^^)-^ 21 ], 



J =2, 3,... K 



if = (H^lj^H^S^ i,j = 2,3... K,j =£i 



where 

(43) 
(44) 
(45) 

Note that T^ 2] = I, the M n x M n identity matrix. We now choose and B so that they satisfy the (K -2){K- 
1) = N + 1 relations in (f4Tb-d42b and then use equations in ( |40T > to determine , . . . V^. Thus, our goal 
is to find matrices VW and B so that 

T W B ^ yli] 

for all i,j = {2,3... K},i^j. 

Let w be the M n x 1 column vector 

" 1 
1 



We need to choose n^ K X ^ K 2 ) 1 



n N column vectors for B. The sets of column vectors of B and VW are 



chosen to be equal to the sets B and V' 1 ' where 



B = 



n 



i[m]\ a m k 



- m,ke{2,3,...K },m/fc,(m,fc)#(2,3) 



w :Va mfc € {0,1,2... n- 1} 



n ( T i rol ) am * 

■ m,ke{2,3,...K},mjtk,(m,k)jt(2,3) 

For example, if K = 3 we get TV = 1. B and VM are chosen as 



w : Va mk G {0,1,2.. .n} 



B = 

yW = 



w Tf ] w 
w Tf ] w 



(Tf )™" 1 w' 



(T' 3] )"w 



To clarify the notation further, consider the case where K — 4. Assuming n = 1, B consists of exactly one element 
i.e B = {w}. The set consists of all 2^ = 2 5 = 32 column vectors of the form 

(T^ ) Q24 (t| ) Q32 (T^ ) a24 (T3 ) Q43 (T^ ) Q42 w 

where all 0:24, 032, 034, 042, 043 take values 0, 1. B and V"W can be verified to have n N and (n + l) N elements 
respectively. 

V"M , i = 2, 3 . . . K are chosen using equations d40l . Clearly, for (i, j) = (2, 3), 



T? ] B = B -< V [1] 



Now, for i± j, i, j = 2... K, (i,j)^(2,3) 



T [i]_g 



n ( t d 

m,k€{2,3,...N},mj£k,{m,k)jt(2,3) 



m] \ Oimk 



V(m, k) ^ {i,j),a mk G {0, 1,2 . . .n - l},<xy G {1,2, ...n} 



=> TyB G yW 
=^T? ] B -< V' 1 ' 



Thus, the interference alignment equations d40b-(f42b are satisfied. 

Through interference alignment, we have now ensured that the dimension of the interference is small enough. 
We now need to verify that the components of the desired signal are linearly independent of the components of 
the interference so that the signal stream can be completely decoded by zero-forcing the interference. Consider the 
received signal vectors at Receiver 1. The desired signal arrives along the (n+ 1)^ vectors H^^VM. As enforced 
by equations (ffOi i. the interference vectors from transmitters 3,4 ... K are perfectly aligned with the interference 
from transmitter 2 and therefore, all interference arrives along the n N vectors H^V^. In order to prove that there 
are (n + l) N interference free dimensions it suffices to show that the columns of the square, M n x M n dimensional 
matrix 



(46) 



are linearly independent almost surely. Multiplying the above M n x M n matrix with (Hi 11 !) 1 and substituting for 
VW and V^, we get a matrix whose Ith row has entries of the forms 

n (ArT-* 

(m,k)e{2,3...K},mjtk,(m,k)jt(2,3) 

and 

(m : k)£{2,3...K} : m^ik,(m,,k)=£(2,3) 

where a m k £ {0, 1, . . . n — 1} and (3 m k G {0, 1, . . . n} and A" lfc , di are drawn independently from a continuous 
distribution. The same iterative argument as in section [TV-Al can be used. i.e. expanding the corresponding deter- 
minant along the first row, the linear independence condition boils down to one of the following occurring with 
non-zero probability 

1) di being equal to one of the roots of a linear equation 

2) The coefficients of the above mentioned linear equation being equal to zero 

Thus the iterative argument can be extended here, stripping the last row and last column at each iteration and the 
linear independence condition can be shown to be equivalent to the linear independence of a n N x n N matrix 
whose rows are of the form Yi( m k )e{2 3 k} m ^k^T k ) amk where a pq G {0, 1, ... n — 1}. Note that this matrix is 
a more general version of the Vandermonde matrix obtained in section IIV-AI So the argument for the K = 3 case 
does not extend here. However, the iterative procedure which eliminated the last row and the last column at each 
iteration, can be continued. For example, expanding the determinant along the first row, the singularity condition 
simplifies to one of 



1) A™ fe being equal to one of the roots of a finite degree polynomial 

2) The coefficients of the above mentioned polynomial being equal to zero 

Since the probability of condition 1 occurring is 0, condition 2 must occur with non-zero probability. Condition 2 
leads to a polynomial in another random variable Af 3 and thus the iterative procedure can be continued until the 
linear independence condition is shown to be equivalent almost surely to a 1 x 1 matrix being equal to 0. Assuming, 
without loss of generality, that we placed the w in the first row (this corresponds to the term a m k — 0, V(m, k)), 
the linear independence condition boils down to the condition that 1 = with non-zero probability - an obvious 
contradiction. Thus the matrix 

H [11I V [l1 H [12 lv[ 2 ]" 

can be shown to be non-singular with probability 1. 

Similarly, the desired signal can be chosen to be linearly independent of the interference at all other receivers 
almost surely. Thus ( {n v +1)N ' +nN , (n+1 " w+ „iv , • • • , (n+1 "iv +ra ;v ) lies in the degrees of freedom region of the K user 
interference channel and therefore, the K user interference channel has K/2 degrees of freedom. 

Appendix II 
Proof of Theorem @]for M even 

Proof: The outerbound is straightforward as before. To prove achievability we first consider the case when 
M is even. Through an achievable scheme, we show that there are M/2 non-interfering paths between transmitter 
i and receiver i for each i = 1,2,3 resulting in a total of 3M/2 paths in the network. 

Transmitter i transmits message Wi for receiver i using M/2 independently encoded streams over vectors vM 

i.e 

M/2 

x [i] w = *) v ™ = vWx m* = 1,2,3 

m— 1 

The signal received at receiver i can be written as 

Y M(t) = H^vWx^t) +H[' i2 lv[ 2 lX 2 (<) +I# 3 ]v[ 3 ]x 3 (t) + Zi(t) 

All receivers cancel the interference by zero-forcing and then decode the desired message. To decode the M/2 
streams along the column vectors of V"W from the M components of the received vector, the dimension of the 
interference has to be less than or equal to M/2. The following three interference alignment equations ensure that 
the dimension of the interference is equal to M/2 at all the receivers. 



span(H [12l V [2] ) = span(H [13l V [31 ) (47) 
H[ 21 lV [1] = H [23I V [3] (48) 
H[ 31 lV [1] = H [32l V [2] (49) 

where span(A) represents the vector space spanned by the column vectors of matrix A We now wish to choose 
V''',i = 1,2,3 so that the above equations are satisfied. Since e {1, 2, 3} have a full rank of M almost 

surely, the above equations can be equivalently represented as 



where 



Let ei,e 2 , . 



span(V [1] ) = span(EV [1] ) 
= FV [1] 
V [3] = GVW 

E = (Hl 311 )- 1 ^ 321 ^ 121 )- 1 ^ 131 ^ 231 )- 1 ^ 211 
F = (H 1321 )"^ 1311 
G = (Hl 23 !)-^! 21 ! 

. eM be the M eigenvectors of E. Then we set Vi to be 



(50) 
(51) 
(52) 



[ei ... e( M /2)J 

Then V*- 2 ' and V^l are found using equations dS0) -( t52t . Clearly, VW,i = 1,2,3 satisfy the desired interference 
alignment equations (l47l l-(|49t. Now, to decode the message using zero-forcing, we need the desired signal to 
be linearly independent of the interference at the receivers. For example, at receiver 1, we need the columns of 
Jjl 11 ) to be linearly independendent with the columns of H^ 21 ! almost surely, i.e we need the matrix below 
to be of full rank almost surely 

HlnlvW H[ 12 lV[ 2 l 

Substituting values for VW and in the above matrix, and multiplying by full rank matrix (H^ 11 !) -1 , the linear 
independence condition is equivalent to the condition that the column vectors of 



ei e 2 



2(M/2) 



Ke, 



.Ke 



(M/2) 



are linearly independent almost surely, where K = (Hl 11 !) -1 !!! 12 ^. 

This is easily seen to be true because K is a random (full rank) linear transformation. To get an intuitive 
understanding of the linear independence condition, consider the case of M = 2. Let C represent the line along 
which lies the first eigenvector of the random 2x2 matrix E. The probability of a random rotation (and scaling) 
K of C being collinear with L is zero. 

Using a similar argument, we can show that matrices 



and 



H^ivi 3 ) Hl 31 ]"VM 



have a full rank of M almost surely and therefore receivers 2 and 3 can decode the M/2 streams of and 
V"[ 3 1 using zero-forcing. Thus, a total 3M/2 interference free transmissions per channel-use are achievable with 
probability 1 and the proof is complete. ■ 

Appendix III 
Proof of Theorem|4]for M odd 

Proof: Consider a two time-slot symbol extension of the channel, with the same chanel coefficients over the 
two symbols. It can be expressed as 

yW = H^XW + H^XM + fi^Xl 3 ! + Zl fc ] i — 1,2,3 



where is a 2M x 1 vector that represents the two symbol extension of the transmitted M x 1 symbol symbol 
XW, i.e 

X W (t) A[xM(l,2t+l) 
[ X[ fe )(l,2< + 2) 

where X^ (i) is an M x 1 vector representing the vector transmitted at time slot t by transmitter k. Similarly Y' k > 
and Zl fc l represent the two symbol extensions of the the received symbol and the noise vector respectively 
at receiver i. fi[ y l is a 2M x 2M block diagonal matrix representing the extension of the channel. 

[ hM(1) 

We will now show (M, M, M) lies in the degrees of freedom region of this extended channel channel with an 
achievable scheme, implying that that a total of 3M/2 degrees of freedom are achievable over the original channel. 
Transmitter k transmits message Wi for receiver i using M independently encoded streams over vectors i.e 



M 

E 



r [fci v [fc] 



y[fe] X [fc] 



where is a 2M x A/ matrix and XJfc] is a M X 1 vector representing M independent streams. The following 
three interference alignment equations ensure that the dimension of the interference is equal to M at receivers 1,2 
and 3. 



The above equations imply that 



rankpft^Vl 2 ]] 

h[ 12 1v [1] 



span(V [1] ) 



rank[H[ 31 lv[ 3 ]] 

g[ 32 ]v [31 
g[ 23 ]v [21 

span(EVW) 
GVW 



(53) 
(54) 
(55) 

(56) 
(57) 
(58) 



where 



E 
F 
G 



(H [13] )" 1 H [231 (H [21] )~ 1 H [31] (H [32] ; 

(H 1131 )" 1 !! 1231 

(H [12l ) _1 H [321 



and E, F and G are 2M x 2M block-diagonal matrices representing the 2M symbol extension of E, F and G 
respectively. Let ei, eg, . . . , &m, be the eigen vectors of E. Then, we pick to be 

ei e 3 . . . e M 
e 2 ... e M -i e M 



(59) 



As in the even M case, and V^l are then determined by using equations (|56|>-(|58|>. 



Now, we need the desired signal to be linearly independent of the interference at all the receivers. At receiver 1, 
the desired linear independence condition boils down to 

span(V [1] ) nspan(KV [1] ) = {0} 

where K = (H 11 )^ 1 ^ 21 ^ (F) _1 and K is the two-symbol diagonal extension of K. Notice that K is an M x M 
matrix. The linear independence condition is equivalent to saying that all the columns of the following 2M x 2M 
matrix are independent. 

ei e3 . . . bm Kei Ke3 ... Kejw 
e 2 ... ejf-i e M Ke 2 ... Ke M -i Ke M 
We now argue that the probability of the columns of the above matrix being linearly dependent is zero. Let 
Cj, i — 1, 2 . . . 2M denote the columns of the above matrix. Suppose the columns Cj are linearly dependent, then 

2M 

Ebj S.t ^ a i C i = 



(60) 



»=i 



Let 



P = {ei, e 3 . . . e M -2, Kei, . . . Ke Af _ 2 } 
Q = {e 2 , e 4 . . . eif-i, Ke 2 , . . . Ke M -i} 

Now, there are two possibilities 

1) olm — OL2M — 0. This implies that either one of the following sets of vectors is linearly dependent. Note that 
both sets are can be expressed as the union of 

a) A set of [(M/2)\ eigen vectors of E 

b) A random transformation K of this set. 

An argument along the same lines as the even M case leads to the conclusion that the probability of the union 
of the two sets listed above being linearly dependent in a M dimensional space is zero. 

2) a 2 Af i= or olm 7^ This implies that 

oiu^M + «2MKejif £ span(P) n span(Q) 
=> span({Ke M , e M }) H span(P) n span(Q) ^ {0} 

Also 

rank(span(P) U span(Q)) = rank(P) + rank(Q) - rank(P n Q) 

rank(P n Q) = 2M - 2 - rank(span(P) U span(Q)) 

Note that P and Q are M — 1 dimensional spaces. (The case where their dimensions are less than M — 1 is 
handled in the first part). Also, P and Q are drawn from completely different set of vectors. Therefore, the 
union of P, Q has a rank of M almost surely. Equivalently span(P) n span(Q) has a dimension of M — 2 
almost surely. Since the set {eju,KeM} is drawn from an eigen vector eM that does not exist in either P 
or Q, the probability of the 2 dimensional space span({e, KeAf}) intersecting with the M — 2 dimensional 
space P n Q is zero. For example, if M = 3, let L indicate the line formed by the intersection of the the 
two planes span({ei, Kei}) and span({e 2 , Ke 2 }). The probability that line L lies in the plane formed by 



span({e 3 , Ke 3 }). Thus, the probability that the desired signal lies in the span of the interference is zero at 
receiver 1. Similarly, it can be argued that the desired signal is independent of the interference at receivers 2 
and 3 almost surely. Therefore (M, M, M) is achievable over the two-symbol extended channel. Thus 3M/2 
degrees of freedom are achievable over the 3 user interference channel with M antenna at each transmitting 
and receiving node. 

■ 
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